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A METHOD AMD A DEVICE FOR ENCRYPTION OP IMAGES 
TECHNICAL FIELD 

The present invention relates to a method and a device for 
encrypting images. 

BACKGROUND OF THE INVENTION AND PRIOR ART 

Encryption of digital data is a technical field which becomes 
important when transmitting and storing secret information or • 
information 'which only shall be available to a user paying for 
the information. Thus, several methods for encrypting digital 
data are in frequent use. 6uch methods can also be applied also 
to digital image lata. Examples of encryption methods are DEg, 
triple DE3 and the public -key RSA method. 

Digital images can be stored on servers and distributed over a 
telecommunication network as digital image data. Images can also 
be distributed using a physical storage medium such, as a CD-ROM. 
Service providers need to establish access control that suits 
their business model. In this context it might be suitable to 
offer partial access to one set of users and full access to 
another set of users. Thus, some of the image data roust be 
encrypted in order to prevent all users from having full access 
to all image data, 

News photographs can e.g. be offered for sale on the Internet. 
The Hervice provider wants to allow customers to download a 
version of the image with reduced quality for evaluation. 
Journals, that want to publish an image, pay for the service and 
are then allowed to download a full quality image. 

However, such a service provider wants to minimize storage space 
and download bit rates. An image provider might alternatively 
want to distribute images on e.g. a CD-ROM. CD-ROMs are given 
away or sold for a low price. Customers can view the images at a 
reduced quality, but they must pay for viewing them at full 
quality. In the case the image provider wants to use the storage 
space on the CD-ROM as efficiently as possible. 
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It is also essential that customer* always can access images 
using user friendly, standardised software, image providers are 
reluctant to design and support special image viewers and 
customers don't want a proliferation of viewing tools, 

Presently, image prtyvidere have to store two versions of the 
images stored- The full quality version is stored as an 
encrypted image file. This means that the image first ia 
compressed and stored in a compressed file format such as JPEG 
or GIF. The compressed file is then encrypted using a suitable 
encryption tool and an encrypted image file is stored. The user 
must first decrypt this file and then access the resulting 
compressed image file using an image viewing tool. Reduced 
quality images are produced by processing the full quality 
images in an image editing program. They are stored as separate 
compressed image files . 

The problems with this solution are that at least two different 
versions of the same image need to be stored, and that both 
versions must also be transmitted over the network in case of 
remote access in the case a customer first wants to see the free 
low resolution image before paying for the full resolution 
version . 

This results in a significant disadvantage if the reduced 
version image contains a large fraction of the image 
information, images that are offered for sale to journals would 
in particular be provided for preview at a fairly good quality 
since journal editors want to have a detailed understanding of 
the image content and accepts only the highest quality for 
printing* The reduced quality image could require . 10-50% of the 
storage space of the full quality image. 

Furthermore, the emerging still image coding standard JPEG 2000, 
which is described in Charilaos christopouloa (ed.), JPEG 2000 
Verification Model Version 2*0, includes many new 
functionalities in comparison with other still image coding 
techniques, They include, in particular, methods for creating a 
wide range of progressive image formate . Bach application domain 
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can select a suitable progression mode, individual objects 
within images can be accessed separately in the JPEG 2000 
bitstxeam and progressive transmission can be applied also to 
objects. In JPEG 2000 there is also support for independently 
decodable coding units * 

SUMMARY 

It is an object of the present invention to overcome the 
problems as outlined above and in particular to reduce the 
amount of memory required for storing an ijnage, which partially 
shall be possible to view, and also to reduce transmission time 
in a transmission scheme transmitting partially encrypted 
images . 

This object and others are obtained by a technique for partial 
encryption and progressive transmission of images where a first 
section of the image file can be decompressed at reduced quality 
without decryption, i.e. the first low quality image is not 
encrypted, and whers a second section of the image file is 
encrypted* 

Thus, users having access to appropriate decryption keywords can 
decrypt this second Hection, The first section together with the 
decrypted second section can then be viewed as a full quality 
image. The storage space required for storing the first and 
section together is essentially the same as the storage space 
required for storing the unencrypted full quality image. The 
encryption of the second section may, depending on the 
encryption method, imply a slight expansion of the second 
section compared to the unencrypted second section . 

The image can also be partitioned into multiple sections where 
each section may be encrypted with an individual encryption 
method and keyword, Some sections may be stored unencrypted. 
An important element of the method and device as described 
herein is that the compressed jjnagss consist of a set of 
independently decodable coding units (CU> , This makes it 
possible to perform encryption operations in the compressed 
domain without performing entropy decoding. 

id^-mi m ounvT mi ii is om 

5/6/05, EAST Version: 2.0.1.4 



WO 00/31964 



4 



PCT/SE99/02I06 



A reduced quality image can be produced according to several 
different main schemes, such as: 

1) Reduced resolution 

2) Reduced accuracy of the transform coefficients. 

3) Exclusion of predefined regions of interest (SOI) 

These methods can be combined bo that a reduced quality image is 
e.g. produced by reducing both the resolution and the accuracy 
of the transform coefficients. 

By using the method and device for storing and transmitting 
image data as described herein, several advantages are obtained. 
Thus, there is no need to store two different versions of an 
image if different users are to have access to different quality 
of the one and sane image. Also, transmission times become much 
lower if the information content of the first, low resolution, 
image data can be reused when transmitting the higher resolution 
image data. 

BRIEF DESCRIPTION OP THE DRAWINGS 

The present invention will now be described in more detail and 
with reference to the accompanying drawings, in which: 

- ?ig. 1 iB a general view of the file structure of an image. 

- Pigs. 2a and 2b shows encryption of images coded according to 
the JPEG 2000 standard. 

- Fig. 3 is a flow chart illustrating some steps carried out 
when encrypting an image. 

- Fig. 4 is a diagram illustrating a client server process. 

- Fig. 5 is a view of an encryption header 

DETAILED DESCRIPTION 

in Pig. l, a general view of the file structure of an original, 
high resolution, image is shown. Thus, the linage data file 
consists of a number of different independently decodable coding 
sections 101, 103 and 105. In the file structure shown in Pig. 
1, the section 101, which is a low resolution version of a high 
resolution image, is coded without encryption and will therefore 
be possible to decode by any receiver. 
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The section 103, which comprises data, which combined with the 
data of section 101, result in a medium resolution version of 
the high resolution image, is encrypted using a first encryption 
method, and only receivers having access to the correct 
encryption key will be able to decode the data stored in the 
section 103. 

The section 105, which comprises data, which combined with the 
data of section 101 and 103 results in a full resolution version 
of the high resolution image, is encrypted using a second 
encryption method, and only receivers having access to the 
encryption key will be able to decode the data stored in the 
section 105. 

Thus, decoding of the section 101 will result in a low 
resolution image version 107, Decryption 109 and decoding of the 
section 103 will, combined with the image data from the section 
101 result in a medium resolution image 111. Decryption 11 J and 
decoding of the section 105 will, combined with the image data 
from the sections 101 and 103 result in a full resolution image 
US. 

Furthermore, implementation in the JPEO 2000 standard without 
ROI, see Charilaoa Christopoulos (ad.) JPEQ 2D00 Verification 
Model Version 2.0, describee how each coding unit of the JPEG 
2000 bitstream can he inserted in the bit stream so that a wide 
range of progressive modes can be supported. 

In JPEO 2000 verification model 2.0, a coding unit is a part of 
the bitstream that encodes a specific bitplane of a given 
subband. In general, a coding unit can be described as any 
independently deeodable subset of image information. The general 
mechanism for specifying the bitstream order is to include so 
called tags that specifies the next coding unit (it is 
sufficient to specify the auhband Bince the bitplane order is 
known) . Several specific modes can be defined in the header that 
defines a default coding unit order thus saving the bits that 
are needed for inserting explicit tags. 
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in Figs, 2a and 2b block diagrams describing how encryption can 
be implemented in the JPEG 2000 encoder and decoder 
respectively, are shown. 

Thva, in Pig 2a a block diagram where encryption is performed 
after entropy coding in the encoder is shown, coding units enter 
an entropy coding block 201. In the block 201 coding the coding 
units are entropy coded using bouks suitable entropy code. The 
output from the block 201 is fed to a Belector which selects a 
suitable encryption method for each entropy coded coding unit. 
Some coding unite can be selected to not be encrypted at all. 

In response to the selection made in the selector 2 03 the 
entropy coded coding units are encrypted in a block 205. The 
encrypted coding units together with the not encrypted coding 
units then form a combined output data stream, which can be 
stored or transmitted. 

in Pig. 2b a decoder for decoding the bit stream generated by 
the encoder in Pig. 2a is shown. Thus, first encrypted and not 
encrypted coding unite enter the decoder via a selector 251, 
which selects a Bui table decryption method for each entropy 
coded coding unit, or if the received coding unit is not 
encrypted it is directly transmitted to a block 255. 

in response to the selection made in the selector 255 the 
entropy coded coding units are decrypted in a block 253 uping a 
suitable decryption algorithm. The decrypted coding units are 
then fed to the block 255. In the block 255 the coding units 
from fed directly from the selector 251 and from the decryption 
block 253 are entropy decoded and combined to form a combined 
output data stream corresponding to the data stream which is fe< 
to the entropy coding block 201 in Pig. 2a. 

Each coding unit in the transmission BCheme as Bhown in the 
Pigs. 2a and 2b is handled as an independently encrypted block. 
Each coding unit can also be encrypted separately with any user 
supplied encryption method. Different units in the same image 
can be encrypted with different encryption methods. The 
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encryption method used can further be an encryption algorithm 
combined with a keyword or a method for generating Keywords. 

Different encryption methods can in such an. embodiment have 
identical algorithms but different keywords, Encryption Method 
Description (BMD) as shown in Figs. 2a and 2b is any global data 
such as ease ion keywords or algorithm identifiers that is needed 
to specify the Encryption Method. Unit Encryption state <UES) is 
a symbol that for each coding unit defines how it is encrypted. 

In Fig. 3, a flow chart illustrating different stepB carried out 
when encrypting an image are shown. First, in a step 301, an 
image to be partially encrypted is received. The image received 
in step 301 is then coded using a coding algorithm generating 
independently decodable coding units , e.g. JPEG 2 000, in a step 
303. 

Next, in a step 305, some of the coding units of the image coded 
in step 303 are encrypted using acme suitable encryption method, 
such as DE9, The coding unite that are chosen to be encrypted 
can be set in accordance with user preferences. Thus, a user can 
chose to have coding units corresponding to ROle, higher order 
bit-planes, etc, encrypted. Finally, the encrypted coding unite 
and the coding units which are not encrypted are merged into a 
single bit stream. 

In Pig. 4, a flow chart illustrating a client -server process, 
when transmitting an image encoded according to the method as 
described in conjunction with Pig. 3 is shown. Thus, a client 
401 is connected to a server 403. The client 401 can then issue 
a request towards the server 403 for a particular image, step 
405. 

The server 403 replies by transmitting the coding units of the 
image which are not encrypted, Btep 407. The not encrypted 
coding units can be decoded by the client who now will have 
access to a low resolution version or a part of the full image. 
Based on this information the client may wish to have access to 
the image in a higher resolution or the full image. If so the 
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client transmits a request to the server requesting Buch 
information, step 4 09. 

The server replies by sending a request to the client requesting 
the client to agree to the conditions for transmitting the 
higher resolution version of the image, step 411. if the client 
agrees via a message 413, e.g. comprising a card number or 
account number from which to bill the coBt for the image, the 
server sends the encrypted coding unite together with a key word 
by means of which the encrypted coding units can be decrypted, 
step 41S. A secure method for key distribution should be used. 
Examples of such secure methods are described in W. atallings 
"Data and computer Communications", p 635 -63 7, prentice- Hall 
1997 fifth edition ISBN 0-13-571274-2. 

If the client already has access to the unencrypted and 
encrypted coding units, for example if he has purchased a CD-ROM 
with images coded as described herein. The scheme as described 
in conjunction can be modified so that no image data ie 
transmitted. Instead the client only agrees to conditions set by 
the server in order to have access to the key word(s) which are 
required to decrypt the encrypted coding units of the CD-ROM. 

In the case when the method and device as described herein is 
UBed when encoding image according to the JPEQ 2000 standard, it 
is advantageous if the JPEG 2 000 standard does not standardise 
encryption methods. An Encryption Header that is included in the 
image header or optionally an Encryption Tag that is merged with 
the JPEG 2000 Taga can instead be used to specify how coding 
units are decrypted. 

In such an embodiment the JPEG 2000 image header contains an 
Encryption Flag (EF) . EF is then set if any coding unit is 
encrypted. An Encryption Header (EH) should then be appended to 
the JPEG 2000 image header and encryption information can 
optionally be merged into JPEG 2000 Tags. 

In Pig. 5 an encryption header is shown. The Encryption Header 
can in such an embodiment contain the following symbols. 

«<• ii»i »w I twt- EUIET rani ■ ta\ 
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1) Encryption. Mode (EM) . A set of standard encryption modes are 
defined e.g. 

a) .One encryption method is UBed for all coding units 

to) Bitplanes of leBB significance then bitplane X are encrypted 

c) Subbands of higher resolution than Y are encrypted 

d) ROIs specified in are encrypted, etc. 

No encryption information need to included in the Tags if an EM 
is defined. 

2) Encryption Mode Parameters (EMPl . Parameters (x, Y , . .,) that 
are used to define the Encryption Mode are set here. 

3} Number of encryption methods used. Several encryption methods 
can be used within the same image if e.g. different user groups 
should be allowed to see different image content. 

4) one Encryption Method Descriptor (EMD) for each encryption 
method. The EMD defines any data that is needed by the 
encryption/decryption module. The type of encryption algorithm 
is defined. A typical use of EMD will be to include a keyword 
that is encrypted by a public key algorithm. The user supplies a 
private key for decrypting the enclosed encrypted key. The 
decrypted key ie used by a fast decryption algorithm to decrypt 
image coding units. The order of the EMDs allocates an number to 
each encryption method. This number is used in UES symbols. 

5) The bifcstream must for each. coding unit specify if it is 
encrypted and. if so by what method, This is done by setting one 
Unit Encryption State (UBS) symbol per coding unit. These 
symbols could either be collected in the encryption header or 
alternatively be distributed in the bitstream as encryption 
tags. If the UES information is kept in the encryption header we 
define a header element - Encryption State (ES) . ES consists of 
a series of UES symbols that are listed in the same order as the 
coding units appears in the bit stream. 

IP BP is set and the Encryption State is not given in the 
5/6/05, EAST Version: 2.0.1.4 
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header, JPEG 2000 TagB can be expanded to contain Unit 
Encryption State (XJES) symbols- EES defines which encryption 
method, if any, that is u B ed for encrypting the next coding 
unit . 

The transform coefficients belonging to a ROI can be handled as 
described above. They can be completely or partially encrypted 
by selecting appropriate coding units belonging to the ROI for 
encryption. 

The main problem is that the ehape of the ROI might reveal the 
content, if the shapes are encrypted it is, however, difficult 
to show a reduced quality image since it is difficult to 
interpret the coded transform coefficients. 

This problem can be solved by defining a so called cloaking 
shape le-shape) - Thus, the real shape of one or several ROIs are 
completely enclosed in the c- shape. The c-shape is designed to 
not reveal sensitive image content. A simple example of a c- 
shape is a bounding box. 

A e-shape is treated as one single ROI in the JPEG 2000 bit 
stream. The c-ehape is coded without encryption as described in 
Charilaoa Christopoulos <ed.), JPEG 2000 Verification Model 
Version 2.0. According to the technique as described therein 
this would result in that the shape is defined in the JPBG 2000 
header. 

A mask is created using the c- shape and the transform 
coefficients belonging to the c- shape is coded and encrypted 
using the method as described herein. This will result in that 
all coefficients belonging to any of the ROIs that are shielded 
by the c- shape are encrypted. The texture of the ROIs ie thus 
protected by encryption. 

The shape of the ROIs are encrypted and stored e.g. in the 
encryption header. The encryption, header contains pointers that 
links encrypted ROI shapes with the corresponding c-shape. 
The decoder can now decode the unencrypted background. The c- 

IPP ^ iniu e levt 
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shape can be displayed as a blank region.. The original ROIs can 
be decoded if the keyword is known. This is don* by decrypting 
the coefficient b belonging to the c-shape. The shape of each ROI 
belonging to the c- shape is also decrypted. The bitstream can 
now be rearranged so that the c- shape is dropped and the 
original ROI" data structures are restored. Note that thie is 
done in the compressed domain. 

The mask that is used for encoding a ROI ie not uniquely defined 
in JPEG 2 000. A mask that is sufficiently large so that the HOI 
is encoded lossless will often cover the whole lower subbands. A 
mask that is not allowed to expand will lead to a lossy encoding 
of the ROI. The masks belonging to different ROTh or to a ROI 
and the background can be designed to overlap. This means that 
some coefficients are encoded in more than one ROI . Such 
overlap will lead to a reduced overall compression but the ROls 
are more independent so that any ROI can be accessed and decoded 
with a good visual result. 

The partial encryption method for ROIb described herein is not 
dependent of the choice of mask as long as the mask is selected 
so that the content of a ROI cannot be reconstructed from the 
content of any other ROI or background. A method for building a 
mask that hides the content of the ROI is described in Charilaos 
Christopoulos (ed.>, JPEG 2000 Verification Model Version 2.0, 

By using the method and device as described herein storage and 
bandwidth requirements for partially encrypted images is 
reduced. Furthermore, object based composition and processing of 
encrypted objects are facilitated, and ROI© can be encrypted. 
Also, the shape o£ a ROI can be encrypted and the original 
object can be decrypted and restored in the compressed domain. 

Another advantage is that encryption doea not need to be 
performed at the same time as encoding the image. Thus, since 
the process takes place in the compressed domain (at the 
bitstream syntax) it is possible to encode all images without 
encryption. The encryption can be performed just before 
transmitting the image by a parser (transcoder) . in this case, 
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if the encryption increase* the bitrate, whicii will be the case 
if the encryption is placed in the TAGS, the increase in bitrate 
ie avoided and the encryption information is only added before 
transmitting it. 
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CLAIMS 

1. A method of partially encrypting image data comprising the 
steps of i 

- coding the image data using *n encoding algorithm generating 
independently deoodable adding units, 

- encrypting at least one of the coding units, and 

- merging coding units which are not encrypted with coding unite 
which are encrypted into a combined hit stream. 

2. A method according to claim 1, characterised in that the not 
encrypted coding unite correspond to a low resolution version off 
the image data. 

3. A method according to any of claims 1-2, characterised in 

that different coding units are encrypted using different coding 
methods. 

4. A method according to any of claims 1-3, eharaoterised in 
that an encryption flag, which indicates if a coding unit is 
encrypted, is inserted in the bit stream. 

5. A method according to any of claims 1-4, when information 
corresponding to a Region of interest is encrypted, 
characterised in that the shape of the region of interest is 
enclosed in a cloaking shape* 

6. A device for partial encryption of image data characterised 
by: 

- means for coding the image data according to an encoding 
algprithm generating independently deoodable coding units, 

- means connected to the coding means for encrypting at least 
one of the coding units, and 

- means for merging coding units which are hot encrypted with 
coding unite which are enarypted. as a combined bitstream. 

7. A device according to claim 6, characterised by means for 
selecting the not encrypted ceding unite as units corresponding 
to a Idw resolution version of the image data. 
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s.- A device according to any of claims 6-7, ©hereoteriaed by 
Tatars for- -encrypting- different coding units using; different 
coding methods. 

9. A device according to any of claims 6 - B, ohereotariaed by 
means for inserting an encryption flag, which indicates if a 
coding unit is encrypted, in the bit stream. 

10. A device according to any of claims 6-9, ehaiaoteriead by 
means for enclosing a region of interest shape in a cloaking 
shape. 
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Application No. 09/803,082 
Reply to Office Action of June 7, 2004 
Attorney Docket: 42390.P10217 

REMARKS/ARGUMENTS 

Applicant has cancelled original claims 1*30 without prejudice. New claims 31-46 are pending 
in the application. 

CLAIM REJECTIONS: 
35 USC S 102(e) 

Claims 1-5. 7-11. 13-17. 19-23 and 25-30 

The Examiner has rejected claims 1-5, 7-11, 13-17, 19-23 and 25-30 under 35 USC § 102(e) as 
being anticipated by U.S. Pat. No. 6,415,031 to Colligan et al. ( B Colligan B ). Although applicant 
disagrees with the Examiner's rejection, in the interests of furthering prosecution of this application 
applicant has cancelled claims 1-5, 7-11, 13-17, 19-23 and 25-30 without prejudice. 

35 USC S 103(a) 

Claims 6, 12. 18 and 24 

The Examiner has rejected claims 6, 12, 18 and 24 under 35 USC § 103(a) as being 
unpatentable over Colligan. Applicant respectfully traverses this rejection. While applicant has 
cancelled claims 6, 12, 18 and 24, applicant has done so without prejudice. 

The Examiner states that, although Colligan "does not disclose the Nth packet being between 
consecutive data packets having a sequence header code," it would, nonetheless, have been obvious 
to modify Colligan to "restart the counter of Fig. 14E when a new header code is detected in the system 
of Colligan" because then "the packet that is encrypted will be in the same relative position; therefore 
reducing the probability of violating the encoder's syntax." (Office Action of June 7, 2004; page 4). 

Applicant respectfully requests that the Examiner clarify her statement regarding "the encoder's 0 
syntax. In particular what encoder's syntax would be violated were Colligan not to be modified as 
suggested by the Examiner? Applicant notes that Colligan fails to disclose or describe an encoder. 
Moreover, applicant respectfully requests that the Examiner describe how Colligan's embodiment of 
Fig. 14E would increase the probability of violating an encoder's syntax. 



Application No. 09/803.082 
Reply to Office Action of June 7, 2004 
Attorney Docket: 42390P10217 

Applicant respectfully asserts that the Examiner's rejection over Colligan fails to establish a 
prima facie case of obviousness. Applicants respectfully direct the Examiner's attention to MPEP 
2143.01 wherein states that a prima facie case of obviousness can 

only be established by combining or modifying the teachings of the prior art to produce the 
claimed invention where there is some teaching, suggestion, or motivation to do so found 
either explicitly or implicitly in the references themselves or in the knowledge generally available 
to one of ordinary skill in the art (emphasis added) 
(citing In re Kotzab . 217 F.3d 1365 (Fed. Cir. 2000)). 

Applicants assert that one of ordinary skill in the art having read and understood the disclosure 
of Colligan would recognize that Colligan's "invention relates to secure video distribution networks" 
(Colligan; col. 1, lines 23-24) wherein a previously encoded Video program is selectively encrypted 
(see, for example, Colligan; col 5, line 59). Thus, applicant asserts that Colligan would provide no 
motivation, as suggested by the Examiner, for one of ordinary skill in the art to modify Colligan to restart 
the counter of Fig. 14E when a new header code is detected precisely because an encoder's syntax 
would not otherwise be violated in the system disclosed by Colligan. In support of this assertion, 
applicant respectfully directs the Examiner's attention to Fig. 14F and the accompanying text of 
Colligan wherein an embodiment utilizing random encryption selection is disclosed (Colligan; col. 13, 
lines 6-29) - if violation of an encoder's syntax were a concern with respect to the system(s) disclosed 
by Colligan then the embodiment of Fig. 14F would be inoperable. 

Thus, applicant asserts that the Examiner has failed to articulate how or where Colligan, either 
explicitly or implicitly, provides motivation to one of ordinary skill in the art to modify Colligan to produce 
the claimed invention. Moreover, applicant asserts that the Examiner has provided no basis for 
concluding that any teaching, suggestion and/or motivation for the modification as suggested by the 
Examiner may be found in the knowledge generally available to one of ordinary skill in the art. 
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Application No. 09/803.082 
Reply to Office Action of June 7, 2004 
Attorney Docket: 42390.P10217 

CONCLUSION 



In view of the foregoing, ft is respectfully asserted that all of the claims pending in this patent 
application are in condition for allowance. 

The required fee for a two month extension of time is enclosed. No additional fees are required 
for additional claims. Should it be determined that an additional fee is due under 37 CFR §§1 .1 6 or 
1,17, or any excess fee has been received, pieJse charge that fee or credit the amount of overcharge to 
deposit account #02-2666. \ 

If the Examiner has any questions, she is invited to contact the undersigned at (503) 264-6473. 
Reconsideration of this patent application and e!arly allowance of all the claims is respectfully requested. 




Patent ^gent 
Intel Corporation 
Reg. No. 55,268 



Dated: Novermber 5, 2004 

c/o Blakely, Sokoioff, Taylor & Zaf man, LLP 
1925 NW AmberGlen Parkway, Suite 230 
Beaverton, OR 97006 
(503) 439-8778 



